Development of summary indices of antenatal care service quality in Haiti, Malawi and Tanzania.

INTRODUCTION: Measuring quality of care in low-income and middle-income countries is complicated by the lack of a standard, universally accepted definition for 'quality' for any particular service, as well as limited guidance on which indicators to include in measures of quality of care, and how to incorporate those indicators into summary indices. The aim of this paper is to develop, characterise and compare a set of antenatal care (ANC) indices for facility readiness and provision of care. METHODS: We created nine indices for facility readiness using three methods for selecting items and three methods for combining items. In addition, we created three indices for provision of care using one method for selecting items and three methods for combining items. For each index, we calculated descriptive statistics, categorised the continuous index scores using tercile cut points to assess comparability of facility classification, and examined the variability and distribution of scores. RESULTS: Our results showed that, within a country, the indices were quite similar in terms of mean index score, facility classification, coefficient of variation, floor and ceiling effects, and the inclusion of items in an index with a range of variability. Notably, the indices created using principal components analysis to combine the items were the most different from the other indices. In addition, the index created by taking a weighted average of a core set of items had lower agreement with the other indices when looking at facility classification. CONCLUSIONS: As improving quality of care becomes integral to global efforts to produce better health outcomes, demand for guidance on creating standardised measures of service quality will grow. This study provides health systems researchers with a comparison of methodologies commonly used to create summary indices of ANC service quality and it highlights the similarities and differences between methods.

Advances in the measurement of coverage for RMNCH and nutrition: from contact to effective coverage.

Current methods for measuring intervention coverage for reproductive, maternal, newborn, and child health and nutrition (RMNCH+N) do not adequately capture the quality of services delivered. Without information on the quality of care, it is difficult to assess whether services provided will result in expected health improvements. We propose a six-step coverage framework, starting from a target population to (1) service contact, (2) likelihood of services, (3) crude coverage, (4) quality-adjusted coverage, (5) user-adherence-adjusted coverage and (6) outcome-adjusted coverage. We support our framework with a comprehensive review of published literature on effective coverage for RMNCH+N interventions since 2000. We screened 8103 articles and selected 36 from which we summarised current methods for measuring effective coverage and computed the gaps between 'crude' coverage measures and quality-adjusted measures. Our review showed considerable variability in data sources, indicator definitions and analytical approaches for effective coverage measurement. Large gaps between crude coverage and quality-adjusted coverage levels were evident, ranging from an average of 10 to 38 percentage points across the RMNCH+N interventions assessed. We define effective coverage as the proportion of individuals experiencing health gains from a service among those who need the service, and distinguish this from other indicators along a coverage cascade that make quality adjustments. We propose a systematic approach for analysis along six steps in the cascade. Research to date shows substantial drops in effective delivery of care across these steps, but variation in methods limits comparability of the results. Advancement in coverage measurement will require standardisation of effective coverage terminology and improvements in data collection and methodological approaches.